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ABSTRACT 


$ 


This  paper  is  an  attempt  to  solve  the  following 
constrained  minimum  problem:  To  present  the  most 
easily  described  algorithm  for  solving  linear 
inequalities  subject  to  the  constraints, 

(1)  The  algorithm  must  be  efficient. 

(2)  It  must  be  shown  to  terminate. 

The  algorithm  is  a  variant  of  the  lexicographic 
simplex  method  which  avoids  using  any  artificial 
objective  function. 


HOW  TO  SOLVE  LINEAR  INEQUALITIES 


by 

David  Gale 

1.  Introduction 

Suppose  you  were  asked  to  solve  a  system  of  simultaneous  linear  inequalities 
of  modest  size,  say  for  example,  four  inequalities  in  three  unknowns.  How  would 
you  proceed?  Or  suppose  that  the  size  of  the  problem  was  immodest  so  that 
machine  computation  was  appropriate?  How  should  the  machine  proceed? 

These  questions,  it  seems  to  me,  are  natural  ones  to  ask,  for  linear  inequalities 
come  up  almost  as  often  as  linear  equations  in  all  sorts  of  applications;  yet 
I  believe  very  few  mathematicians  can  give  a  good  answer  to  them.  I  suspect,  given 
a  little  time,  a  competent  mathematician  could  devise  some  sort  of  finite  algorithm 
which  for  any  system  of  Inequalities  would  either  produce  a  solution  or  else  show 
that  none  existed.  It  would  be  surprising,  though,  if  he  could  on  the  spur  of  the 
moment  come  up  with  a  procedure  that  would  do  the  job  using  only  a  "reasonable" 
amount  of  computation.  By  a  reasonable  amount  of  computation  I  mean  an  amount  of 
tne  same  order  of  magnitude  as  that  involved  in  solving  systems  of  equations.  In 
fact,  this  raises  a  mathematical  question.  Do  there  exist  such  reasonable 
procedures,  or  is  the  inequality  problem  intrinscally  of  a  higher  order  of  computational 
complexity  then  the  equation  problem?  I  would  like  to  expound  briefly  on  the 
present  curious  state  of  affairs  regarding  this  question. 

The  usual  method  for  solving  linear  equations  is  ordinary  "elimination;"  solve 
equation  1  for  x^  and  then  substitute  this  expression  into  equations  2  through  m  , 
etc.  In  this  method  the  basic  step  is  this  elimination,  and  after  each  of  the  n 
variables  have  been  eliminated,  thus  after  n  such  steps,  the  solution  emerges 
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(this  description  is  not  intended  to  be  precise  or  rigorous).  The  algorithm  we  are 
about  to  describe  makes  use  of  these  same  elimination  or,  as  we  shall  call  them, 
replacement  steps.  The  number  of  such  steps  will  in  general  be  greater  than  n  , 
but  not  much  greater,  perhaps  as  much  as  2n  .  Klee  [5]  has  constructed  examples 
which  indicate  that  one  may  run  into  situations  which  require  as  much  as  (roughly) 
mn  steps  and  has  conjectured  that  this  is  the  maximum  possible.  On  the  other  hand, 
the  best  upper  bound  on  the  number  of  steps  which  can  be  rigorously  established  is 
not  even  algebraic  in  m  and  n  but  of  the  order  of  .  Thus  there  is  a  large 

and  embarrassing  gap  between  what  has  been  observed  and  what  has  been  proved. 

This  gap  has  stood  as  a  challenge  to  workers  in  the  fielo  for  twenty  years  now 
and  remains,  in  my  opinion,  the  principal  open  question  in  the  theory  of  linear 
computation. 

One  further  introductory  word  seems  in  order.  There  is  one  group  In  the 
mathematical  community  who  do  know  how  to  solve  inequalities  and  these  are  the 
people  who  work  in  linear  programming.  The  situation  here  is  again  curious. 

Linear  programming  involves  maximizing  or  minimizing  a  linear  function  using 
variables  which  are  required  to  satisfy  a  system  of  linear  inequalites.  Thus, 
in  order  to  solve  a  linear  program  one  must  in  the  process  find  a  solution  of 
these  inequalities.  It  turns  out,  on  the  other  hand,  that  the  problem  of  solving 
inequalities  can  itself  be  thought  of  as  a  linear  programming  problem  in  which  one 
is  minimizing  a  so-called  "artificial  objective  function."  While  this  approach 
achieves  the  desired  end,  it  seems  to  me  to  be  a  backward  way  of  going  about  things. 
Logically  one  would  first  learn  to  solve  the  inequalities  and  then  worry  about 
minimizing  or  maximizing  over  the  set  of  solutions.  This  is  the  approach  taken 
here.  The  method  used  in  the  lexicographic  variant  of  the  simplex  method  of 
Dantzig,  Orden,  and  Wolfe  [1]  which  was  used  by  those  authors  to  solve  linear 


programs  and  later  by  Oantzlg  [2]  to  solve  matrix  games,  but  has  not  up  to  now,  to 
mv  knowledge,  been  used  to  give  a  direct  method  (no  artificial  objective  function) 
for  solving  inequalities.  A  different  direct  method  has  been  given  by  Debreu  [3] 
but  his  procedure  is  more  complicated  to  describe  than  the  one  proposed  here, 
though  it  may  be  computationally  more  efficient  in  some  cases. 

2.  Solving  Matrix  Equations 

We  begin  by  reviewing  the  “standard"  method  for  solving  linear  equations, 
slightly  generalized  and  using  slightly  different  terminology  from  the  usual  one. 

PROBLEM  I:  Given  an  m  x  n  matrix  A  and  an  n  x  r  matrix  B  ,  find  an  n  x  r 
matrix  Y  such  Lnat  AY  ■  B  . 

It  will  be  convenient  to  rephrase  the  problem.  Instead  of  thinking  of  A 
and  B  as  matrices  we  will  think  of  them  as  sets  of  m-veetors.  TV.us 


A  *  {a,,  * . * ,  a  1 
i  n 

B  ■  {b. ,  ...,  b} 
1  r 


Problem:  Express  each  vector  as  a  linear  combination  of  the  veiti  is  a^ 

if  possible. 

We  are  about  to  describe  what  we  will  call  a  replacement  algorithm  for 
solving  (I).  The  following  is  the  fundamental  notion  needed. 


DEFINITION:  Let  S  -  {s, ,  . . . ,  s  }  be  a  basis  for  m-space  and  let  B  ■  {b.,  . 

i  m  i 

be  any  set  of  m-vectors.  The  tableau  of  B  with  respect  to  S  is  the  m  x  r 


.  b 


matrix  Y  -  (y^)  such  that 


!  yt1  V  1  m 

i-1  J 


r,< 


i 


In  matrix  notation.  If  we  think  of  S  and  B  as  matrices  with  columns 


s^  and  bj  then  Y  is  simply  the  solution  if  the  equation  SY  ■  B  ,  or  Y  *  S  B 
We  write  tableaus  in  the  following  manner: 


V 

b2* 

....  bn 

S1 

yll 

y12* 

yln 

*2 

y21 

y22’ 

•’  y2n 

s 

m 

yml 

ym2* 

'  *  *  *  ymn 

Figure  1. 


REPLACEMENT  ALGORITHM:  We  are  going  lO  describe  a  procedure  for  constructing  a 

finite  sequence  of  bases.  The  initial  basis  SQ  consists  of  the  unit  vectors 

{e.,  ....  e  }  ,  and  each  basis  S,  in  the  sequence  consists  of  certain  unit 

1  in  k 

vectors  and  certain  vectors  a,  of  A  .  Reordering  for  convenience,  we  may 

J 

suppose  Sk  -  (a1,  ....  ak>  eR+1 . .  We  write  out  the  tableau  of  A  U  B 

with  respect  to  Sk  as  follows: 

31 
ak 
ek+l 
e 

m 


where  we  denote  the  tableau  of  A  and  B  with  respect  to  Sk  by  Xk  and 
respectively.  There  are  two  cases. 


( 
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Case  I:  The  last  m  -  k  rows  of 


*k 


arc  zero.  Then 


(A)  If  the  last  m  -  k  rows  of  are  also  zero  then  Y^  Is  the 

desired  solution  of  (I)  since  it  expresses  all  the  linearly 

In  a, *  ....  a.  . 

1  k 

(B)  y^  j*  0  for  some  i  >  k  .  Then  the  problem  has  no  solution; 
in  fact,  bj  Is  not  a  linear  combination  of  the  .  To  see 


this  note  that  the  condition  on 


shows  that  the  set 


iaV 


,  a^}  is  a  basis  for  A  ,  but  b^  is  not  a  linear 


combination  of  A^  since  the  term  y  e^  occurs  in  the  expression 
for  bj  in  terms  of  S^.  Hence  the  assertion  follows: 


Case  II:  +  0  for  some  i  >  k  ,  say  i  -  k  +  1  .  Then  let 


be  the  basis  obtained  from  by  replacing  e^+1  by  a^ 


Thus 


k+1 


(V  ....  aR,  aj,  ek+2,  ....  e^  . 


The  proof  that  this  algorithm  solves  Problem  I  is  almost  Immediate.  If 
Case  II  ever  occurs  then  (A)  the  solution  is  either  present  or  (B)  it  is  seen 
not  to  exist.  If  Case  I  never  occurs  then  after  m  replacements  we  will  have 
constructed  a  basis  S  of  vectors  a.  from  A  and  the  tableau  of  B  with 

®  J 

respect  to  this  basis  is  the  desired  solution. 

Note  that  our  method  always  produces  a  basic  solution,  i.e.,  a  solution  Y 
such  that  y^j  f*  0  only  for  the  basis  s^,  ...,  8^  .  This  proves  the  following 
fact  which  may  not  be  immediately  obvious: 


THEOREM  I:  If  (I)  has  a  solution  then  it  has  a  solution  Y  in  which  at  least 
n  -  m  rows  of  Y  are  zero. 

We  now  ask  how  much  computation  the  replacement  algorithm  involves.  Clearly 
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Che  only  arithmetical  step  consists  in  going  from  a  tableau  with  respect  to  a 
basis  S  to  one  with  respect  to  S’  obtained  from  S  by  replacing  a  single  vector. 
In  our  present  notation  let  Y  and  Y’  be  the  tableaus  of  B  with  respect  to 

I 

S  and  S'  and  let  the  ith  row  of  Y  and  Y'  be  denoted  by  y^  and  y^  . 


THEOREM  2:  Let  S  ■  {s^,  . s^}  and  suppose  y^  i*  0  .  Then  S'  *  {b^,  82, 
is  a  basis  and  Y'  is  given  by  the  rule 


a)  yL  -  y^a.  yt  -  y4  -  <yia/yn,>'i  • 


Terminology :  Operation  (1)  Is  known  as  pivoting  and  the  element  y^j  is 
called  the  pivot  element  of  the  operation.  It  is  easiest  to  rememeber  the  operation 
from  these  "pictures" 


Y 


m 


Y 


2 


m 


bl 

bj»  b^ 

© 

y12’  yir 

y2i 

y22'  y2r 

yml 

ym2 . V 

bl 

1>2 *  •  •  •  * 

1 

y12 ’  **•’  ylr 

0 

y 22’  •••*  Y2r 

0 

yra2’  * *•’  yrar 

Figure  A. 


The  pivot  element  <s  circled  in  Y  .  Pivoting  is  done  by  dividing  the  pivot 
row  by  the  pivot  element,  and  by  adding  a  suitable  multiple  of  the  pivot  row  to 
each  of  the  others,  the  suitable  multiple  being  the  one  that  will  give  zeros  in 
the  pivot  column. 


:  61  a  Ilafr  lW 
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Proof  of  Theorem:  Let  Y*  satisfy  (1).  Then  y^  -  y^/y^ 
and  y^'  *  ytj  "  so  for  J  *  1 

,  m  ,  in  m 

yij  bi +  J2  yu  8i  ‘  yij/yn  bi +  J2  yu  si '  <yu/yn)  j2  yu  ‘i 

(m  m  \  m  m 

tL  yn  s‘ '  J2  yn  SV +  J.2  yu  si '  ij  yu  8i  ‘  bj 

so  Y '  is  the  tableau  of  B  with  respect  to  S'  . 

From  rule  (1)  we  see  that  each  pivot  step  requires  mr  multiplications. 

For  the  matrix  equation  problem  the  number  :f  columns  of  the  tableau  is  n  +  r 

(see  Fig.  2.)  and  the  problem  is  solved  in  at  most  m  pivots  so  the  number  of 

2 

multiplications  is  at  most  m  (n  +  r)  .  Actually  one  doeB  some  what  better  than 

this  because  of  the  fact  that  after  each  pivot  one  gets  columns  which  are  unit 

vectors,  like  the  first  column  ol  Y'  in  Figure  4. 

Of  special  interest  is  the  case  where  A  and  B  are  square  m  x  m 

matrices  and  particularly  where  B  is  the  identity  matrix  so  that  b^  is  the 

kth  unit  vector.  In  this  case  X  ,  if  it  exists,  is  A  ^  and  the  pivot  method 

3 

involves  exactly  m  multiplications.  Note  that  this  is  the  number  of  multiplications 

used  in  multlnling  a  pair  of  matrices,  hence  the  number  involved  in  checking  a 

3 

proposed  solution  X  of  AX  ■  I  .  This  suggests  that  m  multiplication  is 
about  as  few  as  one  could  reasonably  expect  to  use  in  solving  the  problem. 

Finally  note  that  we  can  follow  the  steps  of  the  replacement  algorithm  even 
if  there  is  no  B  matrix  at  all.  The  final  tableau  will  then  yield  a  column  basis 
for  A  ,  and  also,  if  one  thinks  about  it  for  a  moment,  a  proof  that  the  row  and 
column  ranks  of  A  are  equal. 
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3.  Solving  Linear  Inequalities 

Problem  11^:  Given  an  m  x  n  matrix  A  and  an  n-vector  a  find  an 
m-vector  y  such  that 

y  >  0  and  yA  >  a  . 

It  is  convenient  to  rewrite  the  problem  as  follows!  Find  an  m-vector  y  such 
that. 


y  aj 

for 

J 

*  1*  •••»  n 

y  e± 

>  0 

for 

i 

*  If  in 

where  {e^} 

are 

the  unit 

vectors  of  m-space. 

Now  there  is  no  difficulty  in  finding  a  finite  procedure  for  solving  II,  for 
it  is  easily  shown,  and  will  emerge  from  the  procedure  to  be  given  here,  that  if 
II  has  a  solution  then  it  has  a  basic  solution,  that  is  a  vector  y  such  that 
y  a^  ■  0^  and  y  ei  *  0  for  some  set  of  m  vectors  and  e^  which  form  a 

basis  for  m-space.  One  could,  therefore,  consider  all  bases  among  the  vectors 
8j,  e^  and  for  each  such  compute  the  solution  y  to  the  corresponding  m  equations 
and  then  substitute  this  y  into  II.  Eventually  one  of  these  vectors  would  satisfv 
the  system  unless  there  was  no  solution  at  all.  Of  course,  this  would  he  an 
enormously  lengthy  procedure  since  it  would  involve  solving  possibly  ('?)  systems 
of  m  equations  in  m  unknowns. 

We  shall  now  describe  a  replacement  algorithm  for  solving  II.  For  this  purpose 
we  wish  to  transform  II  to  a  "homogeneous"  problem,  as  follows: 


•j* 

We  are  treating  the  case  of  nonnegative  solutions  of  inequalities.  The  case  in  which 
y  is  unrestricted  in  sign  can  be  handled  in  a  similar  way  but  involves  some  slight 
technical  complication  which  we  prefer  to  avoid  in  this  exposition. 


( 

.  *"  ' 

mm 
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Let  be  the  (m  +  l)-vector  (-  a  ^ ,  a^)  and  let  6^  -  (0,  e^  for 

1*1,  ....  m  and  let  en  -  (1,  0,  ....  0)  so  that  e..,  6  are  the 

u  U  1  m 

unit  vectors  in  (m  +  l)-space  .  Finally  let  Y  be  all  vectors  (1,  y)  where 
y  is  any  m-vector. 

Problem  II:  Find  y  in  Y  such  that 


y  ^  >  0  for  all  j 
y  ^  >  0  for  all  k  . 

It  is  clear  from  the  definitions  that  Problems  II  and  II  are  equivalent. 

Now  let  S  *  {e„,  s, ,  ....  s  }  be  a  basis  for  (m  +  l)-space  where  sJ 
U  1  m  1 

is  either  a  vector  3^  or  ,  and  write  the  tableau  with  respect  to  this  basis 
as  follows: 


1  n  1’  m 


xo 

y0 

X 

Y 

Figure  5. 


THEOREM  3:  If  xQ  and  y^  are  nonnegative  then  (1,  yQ)  solves  II  (and  yQ  solves 
II). 

Proof :  Let  £  be  the  (m  +  l)-vector  which  solves  the  system 


y  si  ■  0  i  -  1 . m 

y  e0  “ 


l 


(this  vector  exists  since  S  is  a  basis). 


From  the  last  equation  above  £  is  in  Y  . 

Now  from  the  tableau  we  have 

S’  6k  '  y0k(*  e0>  +  ylk(y  8i>  ■  y0k 

so  ^  -  (1,  yQ)  and  by  assumption  y^  >  0  .  Finally 


Y 


xoJ<y 


V 


xij (y  Si) 


°j 


so  y  ■  (1,  y^)  solves  II,  as  asserted. 

The  inequality  problem  has  now  become  that  of  finding  a  basis  S  so  that  the 
tableau  of  Figure  5.  has  its  first  row  nonnegative,  if  such  a  basis  exists,  we 
wish  to  arrive  at  this  basis  by  a  sequence  of  replacements  starting  with  the 
initial  basis  consisting  of  the  unit  vectors. The  initial  tableau  is  given 
below. 


d.  ,  •  •  .  ,  d  ,  .  •  .  ,  & 

1  n  1  m 


"“l . "°n 

0,  ...,  0 

-  A 

I 

Figure  6. 


Now,  as  in  the  previous  section,  we  must  describe  the  replacement  operation. 
Suppose  then  that  we  have  arrived  at  the  tableau  of  Figure  5.,  but  (x^,  y^)  is 
no«.  positive  so  that  say,  <  0  (or  y^  <  0)  .  Then  by  bringing  a^  (or  e^) 

into  the  next  basis  S'  we  can  be  sure  that  in  the  next  tableau  the  entry 


x0j  (or  y0k> 


will  be  zero  which  would  seem  to  be  a  step  in  the  right  direction. 


I*  • 
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The  question  which  remains  to  be  decided  is  which  vector  s^  in  S  should  be 

replaced  by  k  (or  §,  )  and  the  success  of  the  method  depends  on  an  ingenious 
J  k 

criterion  for  making  this  decision  which  we  now  describe. 


DEFINITION:  An  m-vector  x  is  called  lexicographically  positive,  or  simply 
/-positive  if  its  first  (reading  from  the  left)  nonzero  coordinate  is  positive. 
We  write 


x  >  0 

A  vector  x  is  lexicographically  greater  than  y  ,  written  x  ^  y  ,  if 
x  -  y  >  0  . 

It  is  clear  that  for  any  x  i  0  either  x  ^  0  or  -x^O  so  that  ^ 
defines  a  complete  ordering  of  m-space  with  the  further  obvious  property; 

if  x,  y  ^  0  A,  u  >  0  then  Ax  +  wy  ^  0  . 

Finally  we  call  a  matrix  Y  /-positive  if  all  of  its  rows  are  /-positive. 

The  following  is  the  crucial  notion  for  our  algorithm. 

DEFINITION:  The  basis  S  will  be  called  /-feasible  if  the  matrix  Y  (Figure  5.) 
is  /-positive. 

Note  that  the  initial  basis  of  Figure  6.  in  /-feasible  since  in  this  ca9« 

Y  is  the  identity  matrix.  We  now  complete  the  description  of  the  replacement 
algorithm.  Assume  in  the  tableau  of  Figure  5.  that,  say,  Xq^  is  negative  (the 
argument  would  be  the  same  for  y^^  negative).  There  are  two  cases. 

Case  I:  The  first  column  of  X  is  nonpositive.  Then  we  have 

m 

(2)  &1  "  X01  e0  +  Xil  Si  * 


•  k 


v 


In  this  case  II  has  no  solution  for  if  $  solves  II  then  y  s.^  >  0  for  all 

i  ,  but  then  taking  scalar  product  of  (2)  with  £  gives 

» ai  ■  xoi + 1  xuw  V  :  x0i ' 0 

so  9  cannot  solve  II. 

Case  II:  x^  >  0  for  some  i  .  Then  let  I1  «  fijx^  >  0}  and  compute 

y 1^*11  {or  1  ln  and  choose  iQ  in  T1  for  which  Yt /X1 x  Is  /-minimal . 

Then  obtain  the  new  basis  S'  by  replacing  s.  hy  a,  (i.e.,  pivot  on  x  ) 

*0  1  1ol 

The  proof  that  this  algorithm  terminates  depends  on 

LEMMA  2:  The  new  basis  S'  is  again  /-feasible  and  the  vector  yQ  of  the  new 
tableau  is  lexicographically  greater  than  y^  . 


Proof :  From  (1) 


y.  -  y.  /x  .  and  since  y  >0  and  x  .  )>  0 

*0  0  0  X0  0 

I 

it  follows  that  y,  ^  0.  Also  for  i  ^ 

0 

» 

H  ‘  yi  -  (xii/xij>  yi0  • 

t 

If  x^  <  0  then  clearly  y^  ^  0  .  If  x^  >  0  then  by  the  choice  rule  of 
Case  II  above 


yl/xU  <  yi0/xi0i 


Equality  cannot  hold  here  since  this  would  mean  that  y  and  y  were 

1  i0 

proportional  which  is  impossible  since  Y  is  nonsingular,  so  again  y!  ^  0  and 


hence  Y'  is  /-positive. 


Also  from  (1) 
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y°  ‘  y° 

x-..  is  negative,  x  .  is  positive  and  y 

V  0 

as  asserted. 


and  since 

is  /-positive  we  have  y^  ^  y^ 


THEOREM  4:  The  replacement  algorithm  terminates. 

Proof :  Since  the  vector  depends  only  on  the  basis  S  and  since  y^ 

gets  lexicographically  larger  at  each  iteration  it  is  clear  that  no  basis  can  recur. 
Therefore,  one  eventually  arrives  at  the  situation  of  Case  I  in  which  some  column 
of  the  tableau  is  nonpositive  in  which  case  II  has  no  solution,  or  else  eventually 
(Xq,  yg)  becomes  nonnegative  and  y^  is  the  desired  solution. 

4.  An  Example 

Consider  the  system  y.,  y2  >  0 

2y i  +  y2  «  1 
*1  -  1 
-y2  i  -1 

The  initial  tableau  is  then 

S1  k2  *3  *1  *2 

e0 


Now  we  will  bring  a^  into  the  next  basis.  According  to  the  lexicographic 
rule  must  replace  e 2  .  The  pivot  element  has  been  circled  in  the  tableau 


above.  The  next  tableau  is 
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ai  a2  a3 

*1  &2 

eo 

0-1  o 

0  1 

el 

0  Q  2 

1  -2 

al 

10-1 

0  1 

The  only  possibility  now  is  to  replace  e^  by  giving, 


^1 

a2 

a3 

§1 

a2 

eo 

0 

0 

2 

1 

-1 

*2 

0 

1 

2 

1 

-2 

aT 

1 

0 

-1 

0 

© 

Again  there  is  no  choice.  We  must  replace  a^  by  #  and  we  get , 


eo 

1 

0 

1 

1 

0 

a2 

2 

1 

0 

1 

0 

§2 

1 

0 

-1 

0 

1 

which  gives  the  solution  y^  =  1,  y^  *  0  . 

Note  the  way  the  row  vector  y^  increases  lexicographically  with  each 
replacement.  Note  too  the  interesting  fact  that  the  vector  e ^  was  replaced 
on  the  first  pivot  step  but  came  back  in  again  in  the  end.  Of  course,  if  we  had 


chosen  to  bring  in  a ^  instead  of  a^  on  the  first  replacement  we  would  have 


obtained  the  solution  in  one  step.  However,  in  general  there  does  not  seem  to  be 
any  good  way  of  deciding  which  vector  to  bring  in  in  order  to  minimize  the  number 
of  replacements  required  to  arrive  at  a  solution. 
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5.  Concluding  Remarks 

Having  found  an  (apparently)  good  way  to  find  at  least  one  solution  of  a 
system  of  inequalities  one  might  now  ask  for  a  way  of  finding  all  solutions,  which 
means  in  essence  finding  all  basic  solutions  of  II.  There  do  exist  procedures  for 
doing  this  but  it  is  almost  impossible  to  say  whether  these  procedures  are 
reasonable  or  not  because  of  the  fact  that  the  number  of  basic  solutions  may 
increase  very  rapidly  with  m  and  n  .  The  main  interest  here  is  theoretical. 

How  many  basic  solutions  can  there  be  for  an  m  x  n  system?  1  should  like  to 
conclude  by  describing  very  briefly  the  state  of  our  knowledge  (or  ignorance) 

II  . 

on  this  matter.  For  more  details  see  Grunbaum  [4J. 

It  is  conjectured  that  the  maximum  number  p  of  basic  solutions  which  an 
m  x  n  system  can  have  is  given  by  the  strange  looking  formula 


P  (m, 


for  m  odd 


') 


for  m  even. 


This  conjecture  has  in  fact  been  proved  for  "most"  values  of  m  and  n  , 

2 

specifically  for  all  m  <  8  and  for  n  <  m  +  3  and  n  >  (m/2)  -  2  to  see  what 
this  means,  the  first  unsolved  cases  are 


m  =  9  12  <  n  <  18  . 

3  = 

In  general  for  each  m  >  8  there  is  an  interval  of  values  of  n  for  which 
tne  conjecture  has  not  been  verified. 

This  strange  situation  together  with  the  one  described  in  the  introduction 
concerning  the  number  of  replacements  required  to  solve  an  m  x  n  system  are  perhaps 
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the  most  interesting  features  of  what  might  superficially  appear  to  be  a  dull  and 
routine  problem.  To  mix  metaphors  a  little,  they  indicate  how  close  to  the 
surface  the  so-called  frontiers  of  mathematics  sometimes  lie. 


Bibliography 


Dantzig,  G.  B. ,  A.  Orden,  and  P.  Wolfe,  "Generalized  Simplex  Method  for 
Minimizing  a  Linear  Form  Under  Linear  Inequality  Restraints,"  Pacific 
Journal  of  Mathematics.  Vol.  5,  pp.  183-195,  (1955). 

Dantzig,  G.  B.,  "Constructive  Proof  of  the  Min-Max  Theorem,"  Pacific  Journal 
of  Mathematics,  Vol.  6,  pp.  25-33,  (1959). 

Debreu,  Gerard,  "Nonnegative  Solutions  of  Linear  Inequalities,"  International 
Economic  Review.  Vol.  5,  No.  2,  (May  1964). 

Grunbaum,  B.,  CONVEX  POLYTOPES,  John  Wiley  &  Sons,  Nev  York,  (1967). 

Klee,  V.  L.,  "A  Class  of  Linear  Programming  Problems  Requiring  a  Large 

Number  of  Iterations,"  Numerische  MathemaMk-  Vol.  7,  pp.  313-321,  (1965). 


Unclassi f ied 
Security  Classification 


DOCUMENT  CONTROL  DATA  R&D 

(Security  claaaf/fccliun  ol  title  body  ol  ahsfiat  f  and  mde  ninfi  an not a It  on  muat  he  entered  tvhen  the  overall  report  im  i  fassifiaj) 

1  ORIGINATING  ACTlv/|TY  (Corporate  author ) 

[2*  RCPONI  SrCuNITy  LASMFICATION 

Unc 1  ass i f ied 

University  of  California,  Berkeley 

I  2  h  GROUP 

3  REPORT  TITLE 

HOW  TO  SOLVE  LINEAR  INEQUALITIES 

4  DESCRIPTIVE  NOrES  (Tvoa  ol  report  and  inclusive  date*) 

Research  Report 

5  AUTHOR^Sj  fL««i  n«n«.  finl  mme  Imliml) 


GALE,  David 


10  AVAILABILITY  LIMIT  A  TION  NOTICES 


DISTRIBUTION  OF  THIS  DOCUMENT  IS  UNLIMITED. 


n  supplementary  notes  Also  supported  by 

12  SPONSORING  MILITARY  ACTIVITY 

the  National  Science  Foundation  under 

MATHEMATICAL  SCIENCE  DIVISION 

Grant  CP-7417. 

11  abstract 


This  paper  is  an  attempt  to  solve  the  following  constrained  minimum  problem: 

To  present  the  most  easily  described  algorithm  for  solving  linear  inequalities 
subject  to  the  constraints, 

(1)  The  algorithm  must  be  efficient. 

(2)  It  must  be  shown  to  terminate. 

The  algorithm  is  a  variant  of  the  lexicographic  simplex  method  which  avoids 
using  any  artificial  objective  function. 


FORM 

1  J  A  N  64 


1473 


DD 


Unclassified 
Security  Classification 


Unclassified 
Security  Classification 


Lexicographic  Simplex  Method 
Pivotal  Methods 


INSTRUCTIONS 


l  ORIGINATING  ACTIVITY:  Enter  the  name  and  address 
of  the  contractor,  subcontractor,  grantee.  Department  of  De¬ 
fense  activity  or  other  organization  (corporate  author)  issuing 
the  report. 

2a.  REPORT  SECUFBTY  CLASSIFICATION:  Enter  the  over¬ 
all  security  classification  of  the  report.  Indicate  whether 
''Restricted  Data"  is  included.  Marking  is  to  be  in  accord¬ 
ance  with  appropriate  security  regulations. 

2b.  GROUP:  Automatic  downgrading  is  specified  in  DoD  Di¬ 
rective  5200.10  and  Armed  Forces  Industrial  Manual.  Enter 
the  group  number  Also,  when  applicable,  show  that  optional 
markings  have  been  used  for  Group  3  and  Group  4  as  luthor- 
ized. 

3.  REPORT  TITLE:  Enter  the  complete  report  title  in  all 
t  apital  letters.  Titles  in  all  cases  should  be  unclassified. 

If  a  Meaningful  title  cannot  be  selected  without  classifica¬ 
tion  show  title  classification  in  all  capitals  in  parenthesis 
immediately  following  the  title. 

4.  DESCRIPTIVE  NOTES:  If  appropriate,  enter  the  type  of 
report,  e.g. ,  interim,  progress,  summary,  annual,  or  final. 

Give  the  inclusive  dates  when  a  specific  reporting  period  is 
covered. 

5.  AUTHOR(S):  Enter  the  name(s)  of  authors)  as  shown  on 
or  in  the  report.  Entei  last  name,  first  name,  middle  initial 
If  military,  show  rank  and  branch  of  service.  T!»e  name  of 
the  principal  «  >thor  is  an  absolute  minimum  requirement. 

6.  REPORT  DATL:  Enter  the  date  of  the  report  as  day, 
month,  year,  or  month,  year.  If  more  than  one  date  appears 
on  the  report,  use  date  of  publication. 

7a.  TOTAL  NUMBER  OF  PAGES:  The  total  page  count 
should  follow  normal  pagination  procedures,  ue. ,  enter  the 
number  of  pages  containing  information. 

76  NUMBER  OF  REFERENCES:  Enter  the  total  number  of 
references  cited  in  the  report. 

8«.  CONTRACT  OR  GRANT  NUMBER:  If  *>propriate,  enter 
the  applicable  number  of  the  contract  or  grant  under  which 
the  report  was  written 

86.  8l,  fit  8 d.  PROJECT  NUMBER:  Enter  the  appropriate 
military  department  identification,  such  as  project  number, 
subproject  number,  system  numbers,  task  number,  etc. 

9a  ORIGINATOR'S  REPORT  NUMBER(S):  Enter  the  offi¬ 
cial  report  number  by  which  the  document  will  be  identified 
and  controlled  by  the  originating  activity.  This  number  must 
be  unique  to  this  report. 

96  OTHER  REPORT  NUMBER(S):  If  the  report  has  been 
assigned  any  other  report  numbers  (either  by  the  originator 
or  by  the  sponsor),  also  enter  this  number! s). 

10.  AVAILABILITY/LIMITATION  NOTICES:  Enter  any  lim¬ 
itations  on  further  dissemination  of  the  report,  other  than  those 


imposed  by  security  classification,  using  standard  statements 
such  as: 

(1)  "Qualified  requesters  may  obtain  copies  of  this 
report  from  DDC." 

(2)  "Foreign  announcement  and  dissemination  of  this 
report  by  DDC  is  not  authorized." 

(3)  "U.  S.  Government  agencies  may  obtain  copies  o » 
this  report  directly  from  DDC.  Other  qualified  DDC 
users  shall  request  through 


(4)  "U.  S.  military  agencies  may  obtain  copies  of  this 

report  directly  from  DDC  Other  qualified  users 
shall  request  through 


(5)  "All  distribution  of  this  report  is  controlled.  Qual¬ 
ified  DDC  users  shall  request  through 


If  the  report  has  been  furnished  to  the  Office  of  Technical 
Services,  Department  of  Commerce,  for  sale  to  the  public,  indi¬ 
cate  this  fact  and  enter  the  price,  if  known. 

1L  SUPPLEMENTARY  NOTES:  Use  for  additional  explana¬ 
tory  notes. 

12.  SPONSORING  MILITARY  ACTIVITY:  Enter  the  name  of 
the  departmental  project  office  or  laboratory  sponsoring  (pay- 
trig  for)  the  research  and  development.  Include  address. 

13-  ABSTRACT:  Enter  an  abstract  giving  a  brief  and  factual 
summary  of  the  document  indicative  of  the  report,  even  though 
it  may  also  appear  elsewhere  in  the  body  of  the  technical  re¬ 
port.  If  additional  space  is  required,  a  continuation  sheet  shall 
be  attached. 

It  is  highly  desirable  that  the  abstract  of  classified  reports 
be  unclassified.  Each  paragraph  of  the  abstract  shall  end  with 
an  indication  of  the  military  security  classification  of  the  in¬ 
formation  in  the  paragraph,  represented  as  (TS).  (5).  (C).  or  (U) 

There  is  no  limitation  on  the  length  of  the  abstract-  How¬ 
ever,  the  suggested  length  is  from  150  to  225  words. 

J4.  KEY  WORDS:  Key  words  are  technically  meaningful  terms 
or  short  phrases  that  characterize  a  report  and  may  be  used  as 
index  entries  for  cataloging  the  report-  Key  words  must  be 
selected  so  that  no  security  classification  is  required  Identi¬ 
fiers,  auch  as  equioment  model  designation,  trade  name,  military 
project  code  name,  geographic  location,  may  be  used  as  key 
words  but  will  be  followed  by  an  indication  of  technical  con¬ 
text.  The  assignment  of  links,  roles,  and  weights  is  optional 


DD 


FORM 

i  jan  e 


.  1473  (BACK) 


Unclassified 

Security  Class*  fic&tion 


